Poker online

Full House For Online Poker Sites

2005-06-23T22:54:00.000-07:00

Full House For Online Poker Sites
The popularity of online poker soared during 2003, with £38m staked every day during December by gamblers around the world.
The daily online poker betting increased from £6m in January 2003 to £38m in December, while £15bn was spent during the whole year.
Around 150 online poker rooms operate compared with just 30 in 2002.
The company claims that 29 per cent of the UK population plays at least one form of poker online.
Although men dominate the playing community, women tend to win more regularly, earning £7.50 more than their male counterparts per £1,000 stake.
Players are most likely to be in their early thirties and reside in London and the South East, although players from Northern Ireland are more likely to walk away with some of the £3m won daily.

Online Poker

2005-06-09T02:00:00.000-07:00

Beginner's Guide To Online Poker Etiquette

Internet poker continues to enjoy explosive growth, and with upwards of an estimated 45 million poker fans in the United States alone and unprecedented international publicity and interest in the game, there is little evidence to suggest that this hugely entertaining form of gambling will be going off the boil any time soon.
The same precautions for selecting the best site on which to play apply equally to poker as they do to online casinos - visit the top message boards, most of which have poker sections and do a little homework first.
The Internet poker phenomenon has evolved its own unique etiquette to enable fast and trouble free gaming on the many poker room sites, and as always these guides are based on both technology and the human condition. Here's a heads up for beginners:
1) Avoid abusive language or behavior, and do not choose an offensive "handle" that may upset or irritate others - abusive players run the risk of getting their Chat privileges removed at most sites for this sort of behavior.
Report determinedly abusive players to the management via Support - you're there to play poker, have fun and with a combination of luck and skill hopefully win some money, and bad conduct is irrelevant and undesirable.
2) Most sites use the English language only, and this should be respected unless otherwise stated on the site. Exchanges at the table in any other language are looked upon with suspicion and regarded as bad mannered.
3) A facility in the software of many poker rooms, allows you to "silence" other players if they are bugging you - use it rather than retaliating.
4) It is not considered polite to discuss a hand while it is still being played.
5) Do not use your chat to advertise for other poker sites or to promote personal businesses.
6) Do not use your chat to slam or otherwise criticize the site at which you are playing. If you don't like the site, the action or the management exercise your prerogative of choice and take your business elsewhere.
7) Most sites apply international rules concerning "coffee housing", that is, players may not use their chat to adversely influence the play of other gamblers.
8) Creating more than one playing account per person per site will almost certainly bring the wrath of the management down upon you and is generally forbidden on all sites.
9) Try not to agonize and take too long in reaching a play decision - most poker players enjoy a fast game, and if you slow things down unreasonably it may not be well received by other players. Most sites in any case have a time limit where your hand will automatically be checked or folded if you take too long to make a move, depending on whether a bet has been placed. Some systems can even detect whether a player has a connection problem or is just plain slow.
10) But always be courteous - where a fellow player seems to be slowing the game down it is acceptable to comment, but in a polite and friendly fashion.
11) Be advised not to try to improve your play-money ranking by letting a partner raise to the maximum every round and then give him the pot by folding. This is unfair to other players on the top list and is easy to detect.
12) Cheating, collusion and fraud are the enemies of every online player and every site and are grounds for instant and permanent blacklisting.
13) If your Internet connection goes down, don't panic - you will automatically become "all-in" which means that your cards will stay in the game and participate in the showdown, but you will not be eligible to win more than was in the pot when you last made a move.
However, a friendly caution: (1) most sites limit the number of times you can be all-in due to disconnection to 1, 2 or 3 per day, and (2) the all-in benefit does not necessarily apply to all games (such as no limit and tournament games). Be sure to check the site's rules.
If you get disconnected in a tournament game the system will "blind you off". That is, it will pay your blinds and fold your hand whenever it is your turn to act. This will keep you in the game until you can get reconnected.
14) If you and a friend or family member play from the same computer on different accounts, be sure to inform site management and explain the situation before the systems "catch" you. If caught first, without explanation, your accounts will probably be locked.
If you and a friend or family member play from different computers but at the same location, avoid playing together at the same game. Site security systems will usually flag that the computers are near each other and you risk having all accounts locked. (If you want to remove all doubt you can ask the site operator to exclude you from playing at the same table.)
15) If you usually play from a particular location and then change that location (say because you are traveling and using a computer in another city) it is best to inform site management ahead of time. Otherwise, your account could the subject of security flags.
16) If other players ask for your e-mail or IM address, be very careful. Your own poker skills and knowledge, together with these uniquely Internet hints should assure you of an exciting and hopefully profitable "virtual" poker experience - enjoy it to the full and good luck!

poker online games

2005-05-25T23:26:00.000-07:00

Omaha High Poker Tips For The Online Casino April 24, 2005
Omaha High poker is a popular variation of poker that can be found at all good quality online casinos. You should check your favorite online casino to see if they offer this variation of online poker. It is similar in many ways to Hold´em poker. It´s important to clarify the two types of Omaha High poker online games you can find at the online casino: Limit Omaha High –called so because there is a specific betting limit applied in each game and on each round of betting and Pot Limit Omaha High. In this version of online casino poker a player can bet up to what is in the pot.
Omaha poker is closely related to Texas Hold'em poker, another popular card game at the online casino. The difference is that in Omaha poker the players are dealt 4 hole cards unexposed as their initial starting hand prior to the flop and five board cards as community cards. The community cards are exposed to the rest of the table in the center the same as in Texas Hold'em. Betting takes place after each round and the betting order is clockwise.
In Omaha poker there are 3 betting rounds they are: the flop, the turn, and the river. The five community cards and their rankings are used by all players left in the game. When the final betting round arrives the players still in the game will display their cards. To qualify for a winning low hand, a player must have five cards of 8 or less without any pair using two from their hand and three from the board meaning the exposed community cards. Straights or flushes are acceptable for the low hand if all the cards have a value of 8 or below.

Val Kilmer shows off his poker skills.

2005-05-13T12:27:00.000-07:00

Hollywood star Val Kilmer showed off his poker skills during a midnight poker game in an event to celebrate 100 years of Las Vegas.

He was joined by Mick Jagger's daughter, Jade at the event in a London shop - marking the UK launch an online poker internet site.

Poker experts were also at the event to teach poker novices about the game.
Las Vegas came into being in 1905 after 110 acres of land were auctioned by a rail operator.
The gambling city, which boomed in the 1980s, celebrates its centenary on May 15.
Other celebrities who are said to enjoy a flutter include Emma Bunton, Bruce Willis and Meg Mathews.

Play online poker

2005-05-12T11:54:00.000-07:00

If you want to play poker online , the first thing you need to do, is download the software available at the online poker site. It takes no time if you have a fast connection but even if you don’t, the time you wait will worth it.

Hold your enthusiasm; before you can start to play online you need to do a bit of research before you begin.

Sign up with one or more of the free, preferably reputable, message boards where experienced players and others exchange news and views about gambling sites, promotions, gambling software providers and gambling in general. You will soon get a very good idea of which gambling sites to avoid.

The first decision you need to make is which site you should try first. You can have accounts at more than one site if you want.

We recommend trying the free games the site offers you, before playing for real money if you run out of fun money you can request more. It allows you to get used to the site and practice against real poker players from around the world.

There is no better way to learn how to play online poker than by playing. Playing online poker allows you to select your actions before your turn by pushing down a button or highlighting a box, it is important to get accustomed to these buttons and where they are located on the site.
Here we give you some other parameters you should keep in mind before starting to play online poker games:
• Methods of payment
• Fees you are assessed to play online
• Good and complete information about the site itself (owner, location, etc)
• License of the Company
• Company policies
• Kind of customer service

Be extremely careful, a poorly presented site with insufficient information is frequently the sign of a questionable operator. Look for licensing information.

Common Online Poker Mistakes

2005-05-11T09:57:00.000-07:00

Here are a few of the common mistakes made by new players when they sign up to play online poker for the first time.

1) Betting out of turn. You must wait until the player to your right acts. If you bet out of turn this could give an unfair advantage to a player that did not act yet. If you raise out of turn a player that might had called could fold. Or if you fold out of turn you are giving an advantage to the player on your left who now knows you won't raise.
2) Not knowing what the bet is. You have to know what the bet is when it is your turn. After the turn in a limit game the bets are double the amount they were before and after the flop. You must also be aware if the bet was raised.
3) Folding instead of checking. Sometimes if the player does not like the flop or turn he will immediately fold when it is his turn. If you are first to act you can check. If everyone else checks, you get to see the next card for free. The same is true if everyone checks before it is your turn, you should also check. The free card may just make your hand.
4) Throwing chips into the pot. Place your bet in front of you. This way the dealer sees that your bet is correct. He will scoop them into the pot.
5) Not protecting your cards. Place your hands or a chip on top of your cards. If another player's cards mix with yours when they throw in their cards your hand will be declared dead.
6) Throwing a winning hand into the muck. (Discards) The cards speak for themselves. Don't immediately throw in your cards if someone calls out a better hand. The dealer will declare the winner of the hand. If you missed a better hand than you thought you had you might just be the winner.

Beating Bad Poker Players

2005-05-07T18:33:00.000-07:00

The New Players

Over the last year Poker has become the hottest game in the world. To say there is a fascination with the game would be an understatement. The new found interest in poker by millions of people this year can be attributed to a couple of events.
Television has brought Poker out of the cardrooms and into the living rooms of millions of people who have become fascinated with the reality game shows. The Travel channel gambled that the World Poker Tour would attract some viewers. It hit the jackpot when it turned into the Networks top rated show. This was the start of more Poker on Television. In past years ESPN would reduce the annual World Series of Poker into a two hour program. This year they turned it into a multi-program series. There was a six hour broadcast of the Showdown at the Sands Poker Tournament on Thanksgiving Day.
The Bravo Network is broadcasting a Celebrity Poker Tournament and more poker tournaments are set to be televised in the future. Recently, it seems that every broadcasting network is trying to get a poker show on the air. This year should see the poker continue to grow.
Online Poker rooms have been springing up on the Internet and they have been growing as more and more people log on to play poker with players from around the world. When Chris Moneymaker won the 2.5 million dollar first prize at the World Series of Poker in 2004 and Greg Raymer won 5 million in 2005 after winning their entries on an Internet Poker site, millions of would be players dreamed of becoming the next World Champion. Millions of new players flocked to the online poker rooms to try their hand at playing Poker. Many of them have been playing in the freerolls or low limit games in which the players are not very knowledgeable or serious about the game.
The combination of Internet players and television viewers has led to an increased number of new players making their way to the casino card rooms. The Poker Rooms in Tunica have seen the influx of these new players who want to try their hand in a live game. Most of these new players have little or no knowledge of the game other than the basic rules. Many of them have gotten all of their education from watching the tournaments on TV. Texas Hold’em is the game of choice because it is easy to learn the basic rules and this is what they have been watching on TV.
On television they see the pros making huge raises with trash hands and figure that this is the way the game is supposed to be played. Few of them are savvy enough to note that the players are either initiating a raise or re-raising with the trash hands. You will not see the pros merely calling with garbage hands. In addition, what they are seeing on TV is the final table that has been edited down to two hours. The hands shown on TV have been picked for their dramatic outcomes. They don’t see the boring hands where the majority of players have been folding time and time again. They also don’t realize that they are watching a short handed game that starts with six players.

Playing Poker Online

2005-05-06T13:17:00.000-07:00

Pokers popularity continues to skyrocket. The continued television coverage of High Stakes Poker tournaments continues to fuel the fires of desire for many players who dream of being the next millin dollar winner. Five years ago if someone told you a National Television Network would broadcast a Poker tournament opposite the Superbowl pregame show you would probably laugh at the ludicrous idea. But this year NBC did just that and the ratings were astronomical. Poker has become that big and the urge to play casino style poker is growing for many kitchen table players. Millions of players who may have only played in home games are flocking to the casinos and Poker rooms across the country to try their hand at live poker. Many more are getting their first live poker experience online.

Online poker has become very popular and since Chris Moneymaker won the 2003 World Series of Poker after gaining entry from playing in a satellite at an online Poker site, the number of online players has skyrocketed.
This growth in online play is world wide. In the Poker Britain Report (see link in sidebar) it was reported that thirteen million adults have played poker in one form or another and 2.9 million have already or are interested in playing online. In a country of 60 million this is a large percentage. Although there has no similar survey in the United States, given the population of the country one can only imagine that the number of online Poker players is huge and there is no question that this number is growing.
There are a number of reputable online sites that are now catering to millions of players every day. Several years ago I was a little leery about playing online and suggested you limit online play to practice in the free games. I still suggest that all new players get some free practice before putting their money at risk in a live game; however my views online poker has changed. After some research and some actual play over the last two years I am now convinced that it is safe secure and a great alternative for many players who are not able to make a trip to a cardroom without traveling long miles to play poker for a few hours.

"New" to the Online Poker Scene!

2005-05-03T19:47:00.000-07:00

When playing online poker there are a couple things to keep in mind:

1) Play chip land is nothing like playing for real money, even micro limits are miles from play chip.
2) Keep records. Hourly return etc., pokertracker is great software. It's $55 and will make a big difference in your game.
3) Don't expect to be profitable fow a while. It will take some "investment" of both time and money to learn the game; constantly monitor your own play to see where your holes are.
4) Learn the basic math of poker. It's not that difficult but it will make a huge difference; it will teach you when to not to chase good luck.

Online Poker and United States Law.

2005-04-29T10:24:00.000-07:00

Poker Online and United States Law

The direct answer to the title question is: I don't know. I'm not an attorney, a Justice Department official, nor a Supreme Court Justice. Nothing here should be seen as legal advice. What is here is a collection of the best information on this subject that I have been able to find. Use it as you will.

Several recent events have brought attention to the legal standing of online wagering in general. The first thing to understand is the skill game of poker is not the same as sports betting nor even "random chance" casino games like craps and roulette. It may be treated the same eventually, but it may not. Legal precedent for a lot of this simply does not exist. As of this writing, no person has been charged, let alone brought to trial, let alone convicted, let alone sentenced for playing online poker. But this does not guarantee one or more of these things will not happen in the future.

According to Professor I. Nelson Rose, one of the world’s leading authorities on gambling law: "no United States federal statute or regulation explicitly prohibits Internet gambling, either domestically or abroad." Still, the US government has taken the position that certain things are illegal, and more importantly, certain things are worthy of prosecution. The Wire Act is the statute most often cited as making on-line gambling a federal offense. The operative subsection reads: "Whoever being engaged in the business of betting or wagering knowingly uses a wire communication facility for the transmission in interstate or foreign commerce of bets or wagers or information assisting in the placing of bets or wagers on any sporting event or contest, or for the transmission of a wire communication which entitles the recipient to receive money or credit as a result of bets or wagers, or for information assisting in the placing of bets or wagers, shall be fined under this title or imprisoned not more than two years, or both."

poker online list of phrases for you to know what people are typing on the search engines

2005-04-28T10:23:00.000-07:00

online poker 4329 3706 free online poker 1802 1542 poker online 905 775 play poker online 713 610 free online strip poker 592 507 online poker game 449 384 online video poker 356 305 online poker rooms 345 295 online strip poker 338 289 free online poker games 337 288 online poker games 329 282 online casino poker 269 230 online poker site 269 230 online poker tournament 248 212 free online poker game 233 199 online video poker game 206 176 free poker online 199 170 texas holdem poker online 194 166 online party poker 178 152 strip poker online 168 144 play internet poker online 152 130 free online poker fake money 144 123 best online poker 135 116 online poker table 124 106 online pai gow poker 118 101 online strip poker game 115 98 online poker strategy 110 94 casino poker game online 103 88 online casino poker gambling 102 87 free online texas holdem poker 100 86 online poker room 100 86 caribbean poker online 99 85 online poker tournaments 95 81 online poker casino 94 80 playing poker online 94 80 holdem poker online 92 79 texas hold em poker online 89 76 live online poker 87 74 free strip poker online 85 73 best online poker site 83 71 free online video poker 79 68 money online play poker 76 65 multiplayer poker online 76 65 online poker sites 75 64 online betting poker 74 63 best online poker room 72 62 casino internet online poker 72 62 fun online play poker 72 62 internet online poker 72 62 online gaming poker 72 62 online poker game card 72 62 real poker online 72 62 no limit poker online 71 61 poker table online 71 61 texas holdem poker game online 68 58 free strip poker games online 62 53 free online multiplayer poker games 54 46 online poker free 48 41 poker games online 41 35 play poker online for fun 38 33 online poker tools 37 32 online poker assistant 36 31 strip poker free online 35 30 online free poker 33 28 play poker online for free 33 28 poker online free 33 28 casino poker online 31 27 play online poker 31 27 play poker online free 31 27 online poker for mac 29 25 play free online poker 29 25 online casino poker tournament 28 24 online poker bonus 28 24 review poker online 27 23 strip poker online free 27 23 online poker reviews 26 22 free online texas hold'em poker 24 21 online poker for free 24 21 free video poker online 23 20 online poker gambling 23 20 online poker cheats 21 18 free online video strip poker 20 17 free poker games online 19 16 online poker site bonus 19 16 online poker tips 19 16 online video strip poker 19 16 play free poker online 19 16 online poker room reviews 18 15 online poker uk 18 15 poker online no download 18 15 online poker scanner 17 15 play online poker tournament 17 15 online texas holdem poker 16 14 play free strip poker online 16 14 play online strip poker 16 14 poker webcam play online 16 14 cheat at online poker 15 13 live online poker games 15 13 making money playing poker online 15 13 online free poker games 15 13 online live poker 15 13 online poker and taxes 15 13 online poker for fun 15 13 online poker review 15 13 online poker strats 15 13 world poker tour online 15 13 cheat programs for online poker games 14 12 free poker game online 14 12 online poker 4 free for mac 14 12 online poker cheating 14 12 online poker mac 14 12 online poker scams 14 12 play poker for fun online 14 12 poker webcam online game 14 12 best online poker sites 13 11 free online poker sites 13 11 free strip poker online 'same as is' 13 11 making a living playing online poker 13 11 online multiplayer poker 13 11 online poker aide 13 11 online poker no download 13 11 online poker software 13 11 poker online for free 13 11 poker online tournament 13 11 poker tournaments online 13 11 how to win at online poker 12 10 multiplayer online poker 12 10 online holdem poker 12 10 online poker directory 12 10 online poker no downloads 12 10 online poker rules 12 10 online poker security player review 12 10 players online poker 12 10 video poker online 12 10 free online poker for mac 11 9 list of online poker rooms 11 9 online poker cheat 11 9 online poker strategies 11 9 poker school online 11 9 free downloadable or online poker game 10 9 free online poker websites 10 9 free online texas hold em poker 10 9 free online texas holdem and fold poker 10 9 how to make a living playing online poker 10 9 how to play poker online 10 9 international online free strip poker 10 9 online free strip poker 10 9 online single player poker 10 9 play for fun online poker 10 9 play poker online casino 10 9 playing poker blackjack online free 10 9 playing strip poker online 10 9 mac online poker 9 8 omaha poker online 9 8 online freeroll poker tournaments 9 8 online poker free money 9 8 poker free online 9 8 poker sets chips online shopping 9 8 tiger online poker 9 8 download online poker 8 7 free online texas hold 'em poker 8 7 freeroll online poker 8 7 how to win playing online poker 8 7 online poker promotions 8 7 online poker ratings 8 7 online poker tournament money 8 7 stip poker online demos 8 7 virtual poker online 8 7 best online casino poker reviews 7 6 booted poker online 7 6 cheat online poker 7 6 cheats and hacks for online poker 7 6 doyle brunson online poker 7 6 earning a living playing online poker 7 6 free not online texas holdem poker 7 6 free online poker calculator 7 6 free online poker rooms 7 6 free online strip poker sexy women 7 6 free online xxx strip poker games 7 6 free texas holdem poker games online 7 6 free texas holdem poker online 7 6 free to play online video poker games 7 6 how to make money playing poker online 7 6 online + oklahoma + poker 7 6 online poker for macintosh 7 6 online poker freerolls 7 6 online poker in florida 7 6 online poker paypal 7 6 online poker security player forum 7 6 online poker tournaments $3 buy in 7 6 online strip poker free 7 6 play omaha poker online 7 6 poker online for a living 7 6 real online poker 7 6 texas holdem poker online game 7 6 winning online poker 7 6 best online poker rooms 6 5 free 'play slots' online andnot poker 6 5 free + online + poker 6 5 free online bunny poker 6 5 free online poker tournaments 6 5 free online videl poker 6 5 free online video poker for points 6 5 free online video poker games 6 5 free online video poker slots from candyland 6 5 hack the online poker software 6 5 how to cheat at online poker 6 5 live poker online 6 5 online casino poker rooms 6 5 online draw poker 6 5 online gay strip poker 6 5 online poker + taxes 6 5 online poker affiliate 6 5 online poker bible 6 5 online poker cheat programs 6 5 online poker games for mac computers 6 5 online poker hacks 6 5 online poker room skins 6 5 online poker secrets 6 5 online poker site reviews 6 5 online poker tells 6 5 online strip poker play now 6 5 online strip poker sex 6 5 play free online poker for fun 6 5 play holdem poker online for real money 6 5 poker chips online 6 5 poker games and tournaments online at true poker 6 5 poker online for real money 6 5 poker online game 6 5 real money online poker 6 5 strategy to win caribbean stud poker online 6 5 strip poker online games 6 5 video poker recommendations online 6 5 world poker tour online poker 6 5 world series of poker online qualifying 6 5 australian online poker rooms 5 4 best freeroll online poker sites 5 4 best online strip poker 5 4 business that set up online poker business 5 4 free online big tit strip poker 5 4 free online hold em poker 5 4 free online poker no download 5 4 free online poker no downloads 5 4 free online poker tournaments online 5 4 free online strip poker game 5 4 free online strip poker no download needed 5 4 how to win consistently at online poker ebook 5 4 is online poker legal 5 4 legality of online poker in illinois 5 4 let it ride poker and online and poker and free 5 4 no download poker online 5 4 online casino online poker 5 4 online casino poker reviews 5 4 online casinos and poker rooms 5 4 online free poker games 5 4 online game poker 5 4 online poker bonuses 5 4 online poker bots 5 4 online poker calculator 5 4 online poker cheats and scams 5 4 online poker download 5 4 online poker growing at 5 4 online poker in english 5 4 online poker sites rated 5 4 online poker texas holdem 5 4 online texas hold 'em poker 5 4 online texas hold'em poker 5 4 pai gow poker online 5 4 play high speed online poker 5 4 play poker online free mac 5 4 poker online 'texas hold-em' 'free to start ' 5 4 poker free online game 5 4 poker free online video 5 4 poker hacking online 5 4 poker online mac users 5 4 poker online texas 5 4 poker tips online 5 4 stacy, shannon free online strip poker nude 5 4 strip poker games online 5 4 strip poker online game 5 4 texas hold um poker online 5 4 tournament poker online 5 4 world poker online 5 4 3 card poker online 4 3 50 free poker gift hosting web online 4 3 best bet online poker 4 3 best place to play online poker 4 3 best strip poker games online most opponents 4 3 bonus online poker 4 3 can a florida resident play online poker 4 3 casino gambling, online poker 4 3 celebraty online poker 4 3 cheating online poker 4 3 compare online satelite poker tournaments 4 3 copenhagen online poker codes 4 3 cris moneymaker online poker 4 3 free amateur strip poker online 4 3 free let it ride poker

Online Poker practice for live games!

2005-04-27T08:25:00.000-07:00

Poker, poker everywhere …. Poker online has both exploded the former old-boys-club and also sped hundreds of thousand online poker players along the learning curve at a hyper-speed. One neglected area new online poker players should master however is table talk, if they want to play poker in live games.
J Cloutier, a poker legend from the Old School, has publicly scoffed at those old guard poker players who complain that today’s online poker heroes, such as Chris Moneymaker and Greg Raymer failed to pay enough "poker dues" to deserve a place at the final table of big money tournaments. According to T.J., who has busted many a new online poker player who ventures out to Las Vegas poker rooms, new online poker tournament fields simply provide a welcome challenge to old school poker players to master. Apparently, online poker whizzes still have to learn to look across the table at their opponents, yet still maintain their compendium of online poker knowledge. Meanwhile, old school poker players will both use their verbal skills and acumen to evaluate opponents in a way not common to strictly online poker play.

Play Winnig Poker Online!

2005-04-26T18:24:00.000-07:00

Poker online is played by millions of people around the world. Tens of thousands play in casinos and online. A few thousand win. Hundreds make most of their income from the game. This site aims to help people willing to do the work (studying and applying strategic concepts) to be a winning player.
Strategies can be applied to any game, but the primary goal of this information is to help serious players win significant money. Invest time here and you should be able to pound your buddies playing on the kitchen table, but the information is more geared to casino games, tournaments and online poker.

Playing Poker Online poker online

2005-04-22T18:49:00.000-07:00

poker online is an interesting test-bed for artificial intelligence research. It is a game of imperfect knowledge, where multiple competing agents must deal with risk management, opponent modeling, unreliable information, and deception, much like decision-making applications in the real world. Opponent modeling is one of the most difficult problems in decision-making applications and in poker online it is essential to achieving high performance. This paper describes and evaluates the implicit and explicit learning in the poker online program Loki. Loki implicitly "learns" sophisticated strategies by selectively sampling likely cards for the opponents and then simulating the remainder of the game. The program has explicit learning for observing its opponents, constructing opponent models and dynamically adapting its play to exploit patterns in the opponents’ play. The result is a program capable of playing reasonably strong poker online, but there remains considerable research to be done to play at a world-class level. 

1. INTRODUCTION

The artificial intelligence community has recently benefited from the tremendous publicity generated by the development of chess, checkers and Othello programs that are capable of defeating the best human players. However, there is an important difference between these board games and popular card games like bridge and poker online. In the board games, players always have complete knowledge of the entire game state since it is visible to both participants. This property allows high performance to be achieved by a brute-force search of the game tree. In contrast, bridge and poker online involve imperfect information since the other players’ cards are not known, and search alone is insufficient to play these games well. Dealing with imperfect information is the main reason why progress on developing strong bridge and poker online programs has lagged behind the advances in other games. However, it is also the reason why these games promise higher potential research benefits.

poker online has a rich history of scientific investigation. Economists and mathematicians have applied a variety of analytical techniques to certain poker online-related problems. However, since "real" poker online is too complex for this approach, they have studied simplified variants ([15] for example). Other individuals, including expert players with a penchant for mathematics, have gained considerable insight about "real" poker online by using partial mathematical analyses, simulation, and ad-hoc expert experience ([18] is a popular example).

Until recently, the computing science community has largely ignored poker online. However, poker online has a number of attributes that make it an interesting domain for artificial intelligence (AI) research. These attributes include imperfect knowledge, multiple competing agents, risk management, opponent modeling, deception, and dealing with unreliable information. All of these are challenging dimensions to a difficult problem.

There are two ways that poker online can be used as an interesting testbed for artificial intelligence research. One approach is to use simplified variants that are easier to analyze. For example, Findler worked on and off for 20 years on a poker online-playing program for simplified 5-card draw poker online [7]. He modeled human cognitive processes and built a program that could learn. The danger with this approach is that simplification can remove the challenging components of the problem that are of interest to AI researchers. A variant of this approach is to look at a subset of the game, and try to address each component in isolation. Several attempts have been made to apply machine learning techniques to individual aspects of poker online (some examples include [19,21,6]).

The second approach, and the one that we advocate, is to tackle the entire problem: choose a real variant of poker online and address all the considerations necessary to build a program that performs at a level comparable to that of the best human players. Clearly this is the most ambitious approach, but also the one that promises the most exciting research opportunities.

Recently, Koller and Pfeffer have been investigating poker online from a theoretical point of view [13]. They present a new algorithm for finding optimal randomized strategies in two-player imperfect information competitive games. This is done in their Gala system, a tool for specifying and solving problems of imperfect information. Their system builds decision trees to find the optimal game-theoretic strategy. However the tree sizes prompted the authors to state that "...we are nowhere close to being able to solve huge games such as full-scale poker online, and it is unlikely that we will ever be able to do so." In theory, their approach could be used to build an optimal poker online player for a real variant of poker online. In practice, it will require too many computational resources unless further improvements are discovered.

We are attempting to build a program that is capable of playing world-class poker online. We have chosen to study the game of Texas Hold'em, the poker online variation used to determine the world champion in the annual World Series of poker online. Hold’em is considered to be the most strategically complex poker online variant that is widely played.

Our experiences with our first poker online program, called Loki, were positive [1,14]. However, we quickly discovered two limitations to further performance gains:

1 The betting strategy—whether to fold, call, or raise in a given situation—was defined using expert knowledge. This became cumbersome, since it was awkward to define rules to cover all the possible scenarios. Furthermore, any static strategy is suspect. A successful strategy must depend on changing game conditions.

2 Initially, in games played over the Internet, Loki performed quite well. However, some opponents detected patterns and weaknesses in Loki’s play, and they altered their strategy to exploit them. An opponent can exploit any predictable strategy, both in theory and in practice. To be a strong poker online player, one must model the opponent’s play and adjust to it.

This paper describes and evaluates two types of learning in Loki. First, its knowledge-based betting strategy can be viewed as a static evaluation function. In two-player games, such as chess, the quality of the evaluation can be improved through search. In poker online, imperfect information makes a search of the full game tree impractical. Instead, a simulation that samples from the set of likely scenarios can be used to enhance an evaluation. We found that a simple evaluation function augmented by search can uncover sophisticated strategies, as has been observed in perfect-information games. In other words, search compensates for a lack of knowledge. In effect, Loki uses simulations to implicitly learn advanced strategies.

Second, Loki observes and records the actions of each opponent and uses this information to build a simple model of their play. This model is used to predict each opponent’s hidden cards. The program adapts to the style of each opponent and exploits any predictable actions.

We have experimentally assessed each of these styles of learning, both in the laboratory and in play with human opponents. To the best of our knowledge, Loki is the first successful demonstration of using real-time learning to improve performance in a high-performance game-playing program.

This paper describes our previous work on Loki [1,2,3,4,14] and outlines some of the future directions we are pursuing. Section 2 provides an overview of Texas Hold’em. Section 3 identifies the minimal set of requirements necessary to achieve world-class play. Loki’s architecture is described in Section 4. Section 5 discusses the implicit learning used in the betting strategy, while Section 6 addresses the explicit opponent modeling. The performance of the program is assessed in Section 7. Section 8 identifies future work, and Section 9 provides some conclusions.

2. Texas Hold’em

A hand of Texas Hold’em begins with the pre-flop, where each player is dealt two hole cards face down, followed by the first round of betting. Three community cards are then dealt face up on the table, called the flop, and the second round of betting occurs. On the turn, a fourth community card is dealt face up and another round of betting ensues. Finally, on the river, a fifth community card is dealt face up and the final round of betting occurs. All players still in the game reveal their two hole cards for the showdown. The best five-card poker online hand formed from the two hole cards and the five community cards wins the pot. If a tie occurs, the pot is split. Texas Hold’em is typically played with 8 to 10 players.

Limit Texas Hold’em uses a structured betting system, where the order and amount of betting is strictly controlled on each betting round. There are two denominations of bets, called the small bet and the big bet ($2 and $4 in this paper). In the first two betting rounds, all bets and raises are $2, while in the last two rounds, they are $4. In general, when it is a player’s turn to act, one of five betting options is available: fold, call/check, or raise/bet. There is normally a maximum of three raises allowed per betting round. The betting option rotates clockwise until each player has matched the current bet or folded. If there is only one player remaining (all others having folded) that player is the winner and is awarded the pot without having to reveal their cards.

3. Requirements for a World-Class poker online Player

We have identified several key components that address some of the required activities of a strong poker online player. However, these components are not independent. They must be continually refined as new capabilities are added to the program.

Hand strength assesses the strength of a hand in relation to the other hands. The simplest hand strength computation is a function of the cards in the hand and the current community cards. A better hand strength computation takes into account the number of players still in the game, the position of the player at the table, and the history of betting for the current game. An even more accurate calculation considers the probabilities for each possible opponent hand, based on the likelihood of each hand being played to the current point in the game.

Hand potential computes the probability that a hand will improve to win, or that a leading hand will lose, as additional community cards appear. For example, a hand that contains four cards in the same suit may have a low hand strength, but has good potential to win with a flush as more community cards are dealt. Conversely, a hand with a high pair could decrease in strength and lose to a flush as many cards of a common suit appear on the board. At a minimum, hand potential is a function of the cards in the hand and the current community cards. However, a better calculation could use all of the additional factors described in the hand strength computation.

Betting strategy determines whether to fold, call/check, or bet/raise in any given situation. A minimum strategy is based on hand strength. Refinements consider hand potential, pot odds (your winning chances compared to the expected return from the pot), bluffing, opponent modeling and trying to play unpredictably.

Bluffing allows you to make a profit from weak hands, and can be used to create a false impression about your play to improve the profitability of subsequent hands. Bluffing is essential for successful play. Game theory can be used to compute a theoretically optimal bluffing frequency in certain situations. A minimal bluffing system merely bluffs this percentage of hands indiscriminately. In practice, you should also consider other factors (such as hand potential) and be able to predict the probability that your opponent will fold in order to identify profitable bluffing opportunities.

Unpredictability makes it difficult for opponents to form an accurate model of your strategy. By varying your playing strategy over time, opponents may be induced to make mistakes based on an incorrect model. 

Opponent modeling allows you to determine a likely probability distribution for your opponent’s hidden cards. A minimal opponent model might use a single model for all opponents in a given hand. Opponent modeling may be improved by modifying those probabilities based on the collected statistics and betting history of each opponent.

There are several other identifiable characteristics that may not be necessary to play reasonably strong poker online, but may eventually be required for world-class play.

Opponent modeling is integral to successful poker online play. Koller and Pfeffer have proposed a system for constructing a game-theoretic optimal player [13]. However, it is important to differentiate an optimal strategy from a maximizing strategy. The optimal player makes its decisions based on game-theoretic probabilities, without regard to specific context. The maximizing player takes into account the opponent’s sub-optimal tendencies and adjusts its play to exploit these weaknesses.

In poker online, a player that detects and adjusts to opponent weaknesses will win more than a player who does not. For example, against a strong conservative player, it would be correct to fold the probable second-best hand. However, against a weaker player who bluffs too much, it would be an error to fold that same hand. In real poker online it is very common for opponents to play sub-optimally. A player who fails to detect and exploit these weaknesses will not win as much as a better player who does. Thus, a maximizing program will out-perform an optimal program against sub-optimal players.

Although a game-theoretic optimal solution for Hold’em would be interesting and provide a good baseline for comparing program (and human) performance, it would in no way "solve the game." To produce a world-class poker online program, strong opponent modeling is essential.

4. Loki’s Architecture

This section gives a brief overview of the important components of Loki’s architecture [4]. Figure 1 illustrates how these components interact. In the diagram, rectangles are major components, rounded rectangles are major data structures, and ovals are actions. The data follows the arrows between components. An annotated arrow indicates how many times data moves between the components for each of our betting actions.

The architecture revolves around generating and using probability triples. It is an ordered triple of values, PT = [f,c,r], such that f + c + r = 1.0, representing the probability distribution that the next betting action in a given context should be a fold, call, or raise, respectively. The Triple Generator contains our poker online knowledge, and is analogous to an evaluation function in two-player games. The Triple Generator calls the Hand Evaluator to evaluate any two-card hand in the current context. It uses the resulting hand value, the current game state, and expert-defined betting rules to compute the triple. To evaluate a hand, the Hand Evaluator enumerates over all possible opponent hands and counts how many of them would win, lose or tie the given hand.

Each time it is Loki’s turn to bet, the Action Selector uses a single probability triple to decide what action to take. For example, if the triple [0.0,0.8,0.2] were generated, then the Action Selector would never fold, call 80% of the time and raise 20% of the time. A random number is generated to select one of these actions so that the program varies its play, even in identical situations. Although this is analogous to a mixed strategy in game theory, the probability triple implicitly contains contextual information.

After the flop, the probability for each possible opponent hand is different. For example, the probability that Ace-Ace hole cards are held is much higher than the cards 7-2, since most players will fold 7-2 before the flop. There is a weight table for each opponent. Each weight table contains one value for each possible two-card hand that the opponent could hold. The value is the probability that the hand would be played exactly as that opponent has played so far. For example, assume that an opponent called before the flop. The updated probability value for the hand 7-2 might be 2% since it normally should be folded. Similarly the probability of Ace-King might be 60% since it would seldom be folded before the flop, but is often raised. After an opponent action, the Opponent Modeler updates the Weight Table for that opponent in a process called re-weighting. The value for each hand is increased or decreased to be consistent with the opponent's action. The Hand Evaluator uses the Weight Table in assessing the strength of each possible hand, and these values are in turn used to update the Weight Table after each opponent action. The absolute values of these probabilities are of little consequence, since only the relative weights affect the later calculations. The details are discussed in Section 6.

 

 

Figure 1. The architecture of Loki.

Probability triples are used in three places in Loki. The Action Selector uses a probability triple to decide on a course of action (fold, call, raise) as previously described. The Simulator uses probability triples to choose actions for simulated opponent hands (see Section 5). The Opponent Modeler uses an array of probability triples to update the model of each opponent (see Section 6).

An important advantage of the probability triple representation is that imperfect information is restricted to the Triple Generator and does not affect the rest of the program. This is similar to the way that alpha-beta search restricts knowledge to the evaluation function. The probability triple framework allows the "messy" elements of the program to be amalgamated into one component, which can then be treated as a "black box" by the rest of the system. Thus, aspects like game-specific information, complex expert-defined rule systems, and knowledge of human behavior are all isolated from the engine that uses this input.

5. Implicit Learning

Loki's original Action Selector component consisted of expert-defined rules that used hand strength, hand potential, game conditions, and probabilities to decide on an action. A professional poker online player defined the system as a first approximation of the return on investment for each betting decision. As other aspects of Loki improved, this simplistic betting strategy became the limiting factor to the playing strength of the program. Unfortunately, any rule-based system is inherently rigid, and even simple changes were difficult to implement and verify for correctness. A more flexible, computation-based approach was needed.

In effect, a knowledge-based betting strategy is equivalent to a static evaluation function. Given the current state of the game and the hole cards, it attempts to determine the action that yields the best result. If we use deterministic perfect information games as a model, the obvious extension is to add search to the evaluation function. While this is easy to achieve in a perfect-information game such as chess (consider all possible moves as deeply as resources permit), the same approach is not feasible for real imperfect information games because there are too many possibilities to consider [13].

Having an expert identify all the betting rules necessary to play world-class poker online is time consuming and difficult. Decisions must be based on context, within a game and between games. Covering all eventualities is not practical. In such a system, the expert does the learning, transferring his knowledge into new or modified rules. We prefer a dynamic computation-based approach, where the program does the learning as it plays.

Loki’s improved betting strategy consists of playing out many likely scenarios to determine how much money each decision will win or lose. Every time it faces a decision, Loki invokes the Simulator to get an estimate of the expected value (EV) of each betting action (see the dashed box in Figure 1 with the Simulator replacing the Action Selector). A simulation consists of playing out the hand a specified number of times, from the current state of the game through to the end. Folding is considered to have a zero EV, because we do not make any future profit or loss. Each trial is played out twice—once to consider the consequences of a check/call and once to consider a bet/raise. In each trial, cards are dealt to each opponent (based on the probabilities maintained in the Weight Table), the resulting game is simulated to the end, and the amount of money won or lost is determined. Probability triples are used to simulate the actions of the opponents based on the two cards they are assigned for that trial. The average over all of the trials is taken as the EV of each action. In the current implementation we simply choose the action with the greatest expectation, folding if both expectations are negative. If two actions have the same expectation, we opt for the most aggressive one (call over fold and raise over call). To increase the programs unpredictability, we can randomize the selection of betting actions whose EVs are close in value.

Enumerating all possible opponent hands and future community cards is analogous to exhaustive game tree search and is impractical for poker online. However, simulation is analogous to a selective expansion of some branches of a game tree. To get a good approximation of the expected value of each betting action, one must have a preference for expanding and evaluating the nodes that are most likely to occur. To obtain a correctly weighted average, all of the possibilities must be considered in proportion to the underlying probability distribution of the opponent hands and future community cards. The distribution of future community cards is uniform across unseen cards, but the probable opponent hands are not! We use selective sampling to select the most probable hands for each opponent. 

When simulating a hand, we have specific information that can be used to bias the selection of cards. For example, a player who has been raising is more likely to have a strong hand than a player who has just called every bet. For each opponent, Loki maintains a probability distribution over the entire set of possible hands (the Weight Table), and the random generation of each opponent’s hole cards is based on those probabilities. Thus, we are biasing our selection of hole cards for the opponent to the ones that are most likely to occur.

At each node in the decision tree, a player must choose between one of three alternatives. Since the choice is strongly correlated to the quality of the cards that they have, we can use the Triple Generator to compute the likelihood that the player will fold, check/call, or bet/raise in each instance. The player’s action is then randomly selected based on the probability distribution, and the simulation proceeds. As shown in Figure 1, the Simulator calls the TripleGenerator to obtain each of our betting actions and each of our opponent actions. Where two actions are equally viable, the resulting EVs should be nearly equal, so there is little consequence if the "wrong" action is chosen.

It should be obvious that the simulation approach must be better than the static approach, since it essentially uses a selective search to augment and refine a static evaluation function. Barring a serious misconception (or bad luck on a limited sample size), playing out relevant scenarios will improve the default values obtained by heuristics, resulting in a more accurate estimate.

As seen inother search domains, the search itself contains implicit knowledge. A simulation contains inherent information that improves the basic evaluation. For example, a simulation contains implicit knowledge such as:

• hand strength (fraction of trials where our hand is better than the one assigned to the opponent),

• hand potential (fraction of trials where our hand improves to the best, or is overtaken), and

• subtle implications not addressed in the simplistic betting strategy (e.g. "implied odds"—extra bets won after a successful draw).

It also allows complex strategies to be uncovered without providing additional expert knowledge. For example, simulations can result in the emergence of advanced betting tactics like a check-raise, even if the basic strategy without simulation is incapable of this play.

At the heart of the simulation is an evaluation function. The better the quality of the evaluation function, the better the simulation results will be. One of the interesting results of work on alpha-beta has been that even a simple evaluation function can result in a powerful program. We see a similar situation in poker online. The implicit knowledge contained in the search improves the basic evaluation, magnifying the quality of the search. As with alpha-beta, there are tradeoffs to be made. A more sophisticated evaluation function can reduce the size of the tree, at the cost of more time spent on each node. In simulation analysis, we can improve the accuracy of each trial, but at the expense of the total number of trials performed in real-time.

Variations of selective sampling have been used in other games, including Scrabble [17], backgammon [20], and bridge [9]. Selective sampling is similar to the idea of likelihood weighting in stochastic simulation [8,16]. In our case, the goal is different because we need to differentiate between EVs (for call/check, bet/raise) instead of counting events. Also, poker online complicates matters by imposing tight real-time constraints (typically a maximum of two seconds). This forces us to maximize the information gained from a limited number of samples. Further, the problem of handling unlikely events (which is a concern for any sampling-based result) is smoothly handled by our re-weighting system (Section 6), allowing Loki to dynamically adjust the likelihood of an event based on observed actions. An unlikely event with a big payoff figures naturally into the EV calculations.

6. Explicit Learning

In strategic games like chess, the performance loss by ignoring opponent modeling is small, and hence it is usually ignored (although it has been studied [5,11,12]). In contrast, not only does opponent modeling have tremendous value in poker online, it can be the distinguishing feature between players at different skill levels. If a set of players all have a comparable knowledge of poker online fundamentals, the ability to alter decisions based on an accurate model of the opponent may have a greater impact on success than any other strategic principle.

To assess a hand, the Hand Evaluator compares those cards against all possible opponent holdings. Naively, one could treat all opponent hands as equally likely, however this skews the hand evaluations compared to more realistic assumptions. Many weak hands are likely to have been folded before the flop, making them less likely to be held later in the hand. Similarly, a hand made strong by the turn and river cards may have been folded on the flop. Therefore, for each starting hand, we need to define a probability that our opponent would have played that hand in the observed manner. We call the probabilities for each of these (52 choose 2) = 1,326 subcases weights since they act as multipliers in the enumeration computations.

The use of these weights is the first step toward opponent modeling since we are changing our computations based on the relative probabilities our opponent’s possible hole cards. The simplest approach to determining these weights is to treat all opponents the same, calculating a single set of weights to reflect "reasonable" behavior, and use them for all opponents. An initial set of weights was determined by ranking the starting hands (as determined by off-line simulations) and assigning a probability commensurate with the average return on investment of each hand. These results closely approximate the ranking of hands by strong players [18]. 

In Loki, the Opponent Modeler uses probability triples to update the Weight Table after each opponent action. To accomplish this, the Triple Generator is called for each possible two-card hand. It then multiplies each weight in the Weight Table by the entry in the probability triple that corresponds to the opponent’s action. For example, suppose the previous weight for Ace-Ace is 0.7 (meaning that if it has been dealt, there is a 70% chance the opponent would have played it in exactly the manner observed so far), and the opponent now calls. If the probability triple for the current context is [0.0, 0.2, 0.8], then the updated weight for this case would be 0.7 x 0.2 = 0.14. The relative likelihood of the opponent holding Ace-Ace has decreased to 14% because they did not raise. The call value of 0.2 reflects the possibility that this particular opponent might deliberately try to mislead us by calling instead of raising. Using a probability distribution allows us to account for uncertainty in our beliefs. This process of updating the weight table is repeated for each entry.

The above corresponds to what we call Generic Opponent Modeling (GOM). Each hand is viewed in isolation and all opponents are treated as the same player. Each player’s Weight Table is initially identical, and gets modified based on their betting action. Although rather simplistic, this model is quite powerful in that it does a good job of skewing the hand evaluations to take into account the most likely opponent holdings.

Obviously, treating all opponents the same is clearly wrong. Each player has a different style, ranging from loose (plays most hands beyond the flop) to tight (usually plays the few hands that have a very high probability of winning), and from aggressive to conservative. Knowing the style of the opponents allows a player to adjust their betting decisions. For example, if a perceived tight player is betting aggressively, there is a good chance that they have a strong hand. A loose player will play many marginal hands or may bluff a lot. This is useful information and may allow you to fold a strong hand or call with a weak one when it is correct to do so. In general, a bet made by a loose or aggressive player should not be taken as seriously as one made by a tight or conservative player.

Specific Opponent Modeling (SOM) customizes the probability triple function to represent the playing style of each opponent. For a given game, the reweighting factor applied to the entries of the Weight table is adjusted by betting frequency statistics gathered on that opponent from previous hands. This results in a shift of the assumed call and raise thresholds for each player. In the case of a tight player, the call and raise thresholds will increase, indicating fewer hands that are likely to be played. Conversely, a loose player’s thresholds will be lowered. During each round of a game, the history of previous actions by the opponent is used to influence the probability triple generated for that opponent.

In competitive poker online, opponent modeling is much more complex than portrayed here. For example, players can act to mislead their opponents into constructing an erroneous model. Early in a session a strong poker online player may try to create the impression of being very conservative, only to exploit that image later in that session when the opponents are using an incorrect opponent model. A strong player has to adapt their model to the opponents varying their playing style.

7. Experiments

Self-play experiments offer a convenient method for the comparison of two or more versions of the program. Our experiments use a duplicate tournament system, based on the same principle as duplicate bridge. Since each hand can be played with no memory of preceding hands, it is possible to replay the same deal, but with the participants holding a different set of hole cards each time. Our tournament system simulates a ten-player game, where each deal is replayed ten times, shuffling the seating arrangement so that every participant has the opportunity to play each set of hole cards once. This arrangement greatly reduces the "luck element" of the game, since each player will have the same number of good and bad hands. The differences in the performance of players will therefore be based more strongly on the quality of the decisions made in each situation. This reduction in natural variance allows meaningful results to be obtained with a smaller number of trials than in a typical game setting. Nevertheless, it is important to not over-interpret the results of one experiment.

Experiments have been performed with Loki to measure the performance of generic opponent modeling (GOM), simulation (S), and both combined (GOM+S). The results were obtained by playing a self-play tournament containing two enhanced versions of Loki against 8 unenhanced versions. A tournament consisted of 2,500 different deals (i.e. 25,000 games). Each simulation consisted of 500 trials, since the results obtained after 500 trials were reasonably stable. 

The metric used to measure program performance is the average number of small bets won per hand (sb/hand), a metric that is sometimes used by human players. For example, in a game of $10/$20 Hold’em, an improvement of +0.10 sb/hand translates into an extra $30 per hour (based on 30 hands per hour). Anything above +0.05 small bets per hand is considered a large improvement. In play on an Internet poker online server against human opponents, Loki has consistently performed at or above the +0.05 sb/hand level.

The experiments showed that GOM improved performance by 0.031 ± 0.019 sb/hand, simulations improved by 0.093 ± 0.04 sb/hand, and the combination was worth 0.095 ± 0.045 sb/hand (note that these are newer numbers than those appearing in [2,3,4]). The results reported here may be slightly misleading since each experiment used two similar programs. As has been shown in chess, one has to be careful about interpreting the results of these types of experiments.

GOM is a significant gain as expected. Given that all players in the tournaments were variants of Loki, the wide variety of play that is seen in human play is missing. Hence, GOM may be of greater benefit against typical human opponents. Simulations, on the other hand, are a huge win in self-play experiments against non-simulation opponents. As expected, they have a naturally occurring higher variance. The use of simulations represents a large improvement in the quality and variety of the betting strategies employed by Loki (or, possibly, overcome a serious weakness in the older version of the program). Whereas our initial knowledge-based betting strategy routine [1,14] was limited by the amount of knowledge we could code and tune, the simulation-based approach has no such restrictions. The simulations implicitly enable advanced betting strategies, with a degree of unpredictability that makes it harder for the opponents to model Loki.

Note that although each feature is a win by itself, the combination is not necessarily additive because there may be some interdependence between GOM and simulations (i.e. both ideas may exploit the same weaknesses). As well, the magnitude of the simulation improvement is such that it hides the effects of combining it with GOM. The larger the winning margin, the smaller the opportunity there is for demonstrating further improvement against the same opposition.

Each set of improvements reported over the past two years were measured against the previous strongest versions of Loki. As a result, the magnitude of the change may be dampened over time, simply because it is being tested against generally stronger opposition. For example, if you have three generations of poker online-playing programs (A, B, and C) with B defeating A by 0.1 sb/hand and C is better than B by 0.1 sb/hand, it does not follow that C will be .2 sb/hand better than A.

Specific opponent modeling (SOM) is harder to measure, due in part to the nature of our self-play experiments. In previous work we demonstrated improvements for both GOM and SOM against a static default model [2]. However, since that time Loki has improved significantly (for example, with improved reweighting and simulations). A consequence is that our simplistic SOM model has not yet added significantly to the performance of the stronger version of Loki. Improving SOM is our current focus, and some of the ideas we are pursuing are discussed in the next section.

Loki has been tested in more realistic games against human opposition. For this purpose, the program participates in an on-line poker online game, running on the Internet Relay Chat (IRC). Human players connect to IRC and participate in games conducted by dedicated server programs. No real money is at stake, but bankroll statistics on each player are maintained. The new versions of Loki using GOM and simulations win consistently when playing on the IRC server. Although there is a high level of variance in this environment, there is strong evidence that GOM is a major advance in the program’s playing strength against human opposition (as opposed to the self-play experiments where the advantage was not as significant). The performance of the program depends strongly on which players happen to be playing, and on IRC it ranges from novices to professional players. Consequently, it is dangerous to quantify the results of our recent improvements to Loki.

8. Ongoing Research

The work reported here is our first experience with a betting strategy based on simulations and opponent modeling. Each area has numerous opportunities for improvement, some of which are currently being addressed. Indeed, the poker online project is rich in research opportunities. There is no shortage of good ideas to investigate; only a shortage of time and resources.

For the simulations, the major problem is variance (standard deviation) in the results. We have identified several ways in which the experiments could be conducted with less noise. Nevertheless, even with these enhancements, we expect the variance to still be high. Faster machines and parallel computations might be helpful since this will result in a larger sample of simulation data points. However, this has diminishing returns and our experiments suggest that beyond a critical minimum number of simulation data points (in the 100-500 range) the benefits may be small.

There are tradeoffs in doing the simulations. Currently, each data point contains a small amount of information about the expected value. Given the simplicity of the calculation, one can acquire numerous data points. Alternatively, one could do fewer simulations, but have each return a more accurate value. The quantity versus quality trade-off needs to be explored in more detail.

For the game of bridge, simulations have successfully allowed computers to play hands at a world-class level (GIB [9]). Nevertheless, limitations in the simulation-based approach and the high variance have prompted the author of GIB, Matt Ginsberg, to look at other solutions (including building the entire search tree) [10]. We too may have to look for new approaches to overcome the limits of simulations. 

In the area of opponent modeling, there are numerous avenues that can be explored. One serious limitation of our current work that needs to be address is the resistance to change that is built into our system. Our opponent modeling works well in some cases because most of the opponents have a fixed style that does not vary over time (certainly the computer opponents that we use in our self-play experiments have this property). However, it does not necessarily follow that opponent modeling will be as successful in games against human players as it is in the closed experiments. Humans are also very good at opponent modeling, and can be much less predictable than the players in our experiments. We have not yet investigated making our opponent models quickly responsive to perceived changes in an opponent’s style. For a strong human player, a single data point is often sufficient for them to set or alter their model of an opponent. Our models are far too slow to adapt. This must change!

A sampling of some of the ideas being investigated include:

• Use the simulations to refine the opponent modeling. Having done a simulation, record the expected reaction for each opponent. If their actions frequently differ from what is predicted, then Loki can adjust its opponent model.

• With opponent modeling, it is easy to gather lots of data. The problem is filtering it and attaching the appropriate importance to it. Without this, our modeling will be too slow to react, or base its decisions on irrelevant information. We are investigating condensing the data into simpler metrics that may be better predictors of an opponent’s style and future behavior. For example, measuring the amount of money that a player invests per game may be a good predictor of loose/tight play.

• Previous specific opponent modeling was hampered by the crude method used for collecting and applying observed statistics. Much of the relevant context was ignored for simplicity, such as combinations of actions within the same betting round. A more sophisticated method for observing and utilizing opponent behavior would allow for a more flexible and accurate opponent model. For example, we are currently experimenting with modifying our model based on sequences of opponent’s actions. A check followed by a raise (typically a show of strength) has more meaning than looking at these two actions in isolation. 

• Loki does not currently use showdown information. The cards seen at the showdown reveal clues about how that opponent perceived each decision during the hand. These hindsight observations can be used to adaptively measure important characteristics like aggressiveness, bluffing frequency, predictability, affinity for draws, and so forth.

• We have yet to fully explore the variety of techniques available in the literature for learning in a noisy domain where one must make inferences based on limited data.

9. Conclusions 

To master the game of poker online, one must be adaptive. Any form of deterministic play can and will be exploited by a good opponent. A player must change their style based on the dynamic game conditions observed over a series of hands (looking at each hand in isolation is an artificial limitation). Our work has made some progress towards achieving a poker online-playing program that can learn and adapt. Loki successfully uses opponent modeling to improve its play. However, it is abundantly clear that these are only the first steps, and there is considerable room for improvement.poker online

poker online is a complex game. Strong play requires the player to excel in many different aspects of the game. Developing Loki has been a cyclic process. We improve one aspect of the program until it becomes apparent that another aspect is the performance bottleneck. That problem is then tackled until it is no longer the limiting factor, and new weaknesses in the program’s play are revealed. We made our initial foray into opponent modeling and were pleased with the results. With the success of the new simulation-based betting strategy, opponent modeling is now back on the critical path since it will offer the biggest performance gains. We will now refocus our efforts on that topic, until it too moves off the critical path.poker online

poker online is taken seriously by anyone who plays for real money

2005-04-19T08:29:00.000-07:00

poker-online is taken seriously by anyone who plays for real money, any edge you can get really helps, The resources available at best-poker-deals.com shorten the learning curve to playing better poker and putting you on the fast track to winning.